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ABSTRACT 

Objectives: The Iowa Healthy and Active Minds Study 
is a four-arm randomised controlled trial of a visual 
processing speed training programme (Road Tour). 
This article presents the preplanned interim results 
immediately after training (6-8 weeks post- 
randomisation) for the primary outcome. 
Design: Within two age strata (50-64 vs >65), 681 
men and women attending general internal and family 
medicine clinics were randomised to four training 
groups: (1) supervised, on-site standard (10 h) dose of 
Road Tour training; (2) supervised, on-site standard 
dose of Road Tour training with 4 h of subsequent 
booster training scheduled to occur at 11 months 
post-randomisation (ie, no booster training had 
occurred at the time of this interim analysis); 

(3) supervised, on-site standard dose of attention 
control (crossword puzzles) training and 

(4) self-administered, at-home standard dose of Road 
Tour training. The primary outcome was the Useful 
Field of View (UFOV) test. Three intent-to-treat interim 
analyses were conducted, including (1) multiple linear 
regression models of composite UFOV scores using 
Blom rank transformations, (2) general linear mixed 
effects models and (3) multiple logistic regression 
models among the 620 participants (91%) with 
complete data. 

Results: In the linear regression analyses of both age 
strata, random assignment to any Road Tour training 
group versus the attention control group was 
significant (p<0.001), with an effect size of -0.558 
(adjusted for the Blom rank transformed UFOV score at 
randomisation). Similar results were obtained for each 
Road Tour group and within each age stratum and 
from the general linear and logistic regression models. 
Conclusions: Assignment to a standard dose of Road 
Tour training yielded medium-sized post-training 
improvements in visual processing speed. Road Tour 
was equally effective whether administered under 
laboratory supervision or self-administered in the 
patient's home and for participants in both age strata 
(50-64 vs >65). 

Clinical trial registration number: NCT01 165463. 



ARTICLE SUMMARY 



Article focus 

■ Normative age-related declines in cognitive 
functioning leave a pressing need to identify 
efficient and effective training interventions for 
older adults. 

■ The Iowa Healthy and Active Minds Study is 
a four-arm randomised controlled trial of three 
modes of delivering a computerised visual speed 
of processing intervention versus an attention 
control group. 

Key messages 

■ The Iowa Healthy and Active Minds Study is the 
first randomised controlled trial to evaluate the 
efficacy and effectiveness of Road Tour, 
a second-generation computerised visual speed 
of processing intervention. 

■ Statistically significant medium-sized post- 
training improvements in visual processing 
speed were observed regardless of delivery 
method or age strata. 

Strengths and limitations of this study 

■ This randomised controlled trial uses a large 
sample of men and women aged >50 years old 
and overcomes four of the five important 
limitations (exclusion of 50-64-year-olds, 
use of a no-contact control group, adherence- 
conditioned assignment to booster training and 
reliance on a supervised cognitive training 
programme) of a previous multisite trial. 

■ The sample was drawn from just one family care 
centre in which minorities were underrepre- 
sented, participants had to have a home 
computer and internet access, and data on 
the primary outcome were available only at 
randomisation and post-training. 
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INTRODUCTION 

It is well established that age-related cognitive 
decline is a normal part of the ageing process 
that occurs across many cognitive functions 
including memory, orientation, attention, 
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abstract thinking and perception. 1 4 These age-related 
cognitive changes can be viewed as the result of physical, 
behavioural and environmental changes that combine to 
promote negative brain plasticity and degradations in 
functioning.' Fortunately, this capacity for physical and 
functional brain change across the lifespan is bi-direc- 
tional. 5 6 Indeed, just as brain plasticity can lead towards 
degradation in cognitive functioning with age, this same 
plasticity process can also be used to strengthen cognitive 
abilities. 7-9 This is especially important given recent 
evidence demonstrating that these age-related declines 
commence as early as age 28 and then continue in 
a linear fashion throughout the remainder of the life 

9 

course. 

Many training programmes have been developed to 
help mitigate these age-related cognitive functioning 
declines. Although the gains associated with most earlier 
cognitive training interventions appeared to be highly 
task and context specific, more recent developments 
have demonstrated that improving the coordination 
of executive skills can transfer beyond the testing envi- 
ronment. 7 These often involve complex video games, 
task-switching paradigms or divided attention tasks 
because these training platforms provide a carefully 
controlled and well-structured environment. Some of 
these successful interventions have focused on 
improving visual information processing speed, which is 
not surprising given the considerable evidence that 
supports the role of processing speed in age-related 
cognitive decline. 10 12 

Perhaps the most extensively evaluated intervention 
that targets improving visual processing speed is that 
developed by Ball and Roenker. 4 3 14 Their programme 
trains users to improve the speed and accuracy with 
which they identify and locate visual information using 
a divided attention format. Over time, the difficulty and 
complexity of each task is systematically increased as 
users attain specified performance criteria. Manipula- 
tions to increase difficulty include decreasing visual 
stimuli duration, adding visual or auditory distracters, 
increasing similarity between target and distracter 
stimuli, and presenting visual targets over a broader 
spatial expanse. The basic tasks, however, are always the 
same — central discrimination and peripheral target 
location. Substantial evidence from the US National 
Institutes of Health (NIH)-funded multisite randomised 
controlled trial (RCT) known as ACTIVE (Advanced 
Cognitive Training for Vital Elderly) has shown the 
efficacy of Ball and Roenker's visual processing speed 
intervention on both immediate and distal cognitive 
functioning, as well as on subsequent health 

15—24 

outcomes. ' 

Posit Science Corporation (San Francisco, California, 
USA) acquired the rights to Ball and Roenker's visual 
speed of processing training programme in 2007. 4 3 14 
While all the original tasks were maintained, the delivery 
platform was modified to be user-friendly and self- 
administered. Gaming elements were also added to 



improve user engagement and enhance compliance. 
The resulting second-generation computerised visual 
speed of processing training programme is known as 
Road Tour and has been commercially available since 
2009 as part of the Insight visual processing speed suite 
(which includes four other visual training programmes 
known as Bird Safari, Jewel Diver, Master Gardenerand Sweep 
Seeker) or as part of the DriveSharp driving suite (which 
also includes Jewel Diver and Sweep Seeker) (http://www. 
positscience.com/our-products). 

We designed the Iowa Healthy and Active Minds Study 
(IHAMS) to evaluate the efficacy and effectiveness of 
Road Tour. The IHAMS is a four-group parallel RCT 
(NCT01 165463) whose protocol has been described in 
detail elsewhere. 25 In this article, we report on the 
preplanned interim results immediately after training 
(6—8 weeks post-randomisation) for the primary 
outcome. Because standard booster training did not 
commence until 11 months post-randomisation and 
because little if any supplemental training beyond 10 h 
in the at-home group would have occurred until after 
6—8 weeks post-randomisation, we hypothesised that 
participants randomised to any of the three Road Tour 
training groups (no booster training subsequently 
scheduled, booster training scheduled to occur much 
later at 11 months post-randomisation and at-home 
training with self-dosing allowed after 6—8 weeks post- 
randomisation) should have significantly and similarly 
greater improvements in visual processing speed imme- 
diately after training than the attention control group. 
This planned interim post-training analysis represents 
hypothesis HI from the original IHAMS protocol 25 and 
can only be evaluated for the primary outcome because 
the secondary outcomes were not assessed at 6—8 weeks 
post-randomisation. 

METHODS AND ANALYSIS 
Overview 

Figure 1 shows the IHAMS study design and participant 
recruitment results, with additional details available in 
the article describing the study protocol. IHAMS used 
a 3:3:4:4 allocation ratio and block randomisation sepa- 
rately within two age strata (50—64 (mean=57.2, 
SD=4.2, range=50-64) vs >65 (mean=71.4, SD=5.7, 
range=65— 87)). A total of 681 participants were rando- 
mised to one of the following groups: (1) 10 h (a single 
2 h session each week over the first 5—6 weeks) of 
supervised on-site training using Road Tour (N=154), 
(2) 10 h of supervised on-site training using Road Tour 
plus 4 h of future booster training at 1 1 months post- 
randomisation (N=148), (3) 10 h of supervised on-site 
attention control using computerised crossword puzzles 
(Boatload of Crosswords, Boatload Puzzles; LLC, Yorktown 
Heights, New York, USA) (N=188) or (4) self-adminis- 
tered at-home training using Road Tour for 10 h or more 
over the next 5—6 weeks without guidance on the 
number of sessions or their length (N=191), with the 
option to continue using Road Tour thereafter but not 
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Figure 1 IHAMS CONSORT 
flow diagram. 
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to use any of the four other training programmes from 
the Insight software suite until the study was over. Post- 
training assessments occurred at 6—8 weeks post- 
randomisation, and complete baseline and post-training 
data were obtained for 620 participants (91%). One year 
post-randomisation assessments are scheduled to be 
completed by late November 201 1. The IHAMS was sized 
to provide &80% power to detect an effect size of 0.25 in 
the primary outcome at 1 year post-randomisation with 
a=0.05. 

Sampling frame 

We included all patients attending either the general 
internal or family medicine clinics of the University of 
Iowa's Family Care Center (FCC) in the IHAMS 
sampling frame. The electronic medical record was used 
for initially selecting potentially eligible participants. 
The initial inclusion criteria were (1) age &50 years old, 
(2) two or more visits to a primary care physician in the 
FCC in the past year and (3) the absence of diagnostic 
codes for Alzheimer's or Picks' disease, arteriosclerotic 
dementia, other senile or pre-senile dementia, dementia 
due to alcohol or drugs, amnestic syndrome, or 
dementia due to other organic conditions. A total of 
5743 potentially eligible patients were identified. Weekly 
random replicates of 100—250 of them were sent a letter 
describing the study and asking them to telephone the 
project office and indicate whether or not they were 
interested in participating. 

Telephone screening 

We attempted to further screen all potentially eligible 
patients but could not reach 1627. Of the 4116 
remaining potentially eligible patients, 2079 declined to 
participate and 966 had not yet been sent their letter 
describing the study by the time that study enrolment 
was closed, leaving 1071 potentially eligible patients. We 



conducted brief screening interviews to identify who 
among them met any of the following exclusion criteria: 

(1) significant cognitive impairment based on three or 
more errors on a 10-item Mental Status Exam (N=15), 26 

(2) significant self-reported uncorrected visual acuity 
problems (N=63), (3) not having a personal computer 
with a CD-ROM in the home (N=303), (4) not having 
internet access (N=8) or (5) having previously used 
a computerised programme for improving cognitive 
function (N=l). This resulted in the exclusion of 390 
potential participants. 

Informed consent and baseline interviews 

After completing the screening interview, eligible 
patients were scheduled for a 2 h visit to our laboratory 
where written informed consent was obtained for the 
681 participants who were enrolled between 22 March 
and 16 November 2010. The 681 enrolees were then 
administered their baseline (randomisation) interviews 
by trained research assistants using computer-assisted 
interviewing protocols. Immediately afterwards, each 
participant was randomised to one of the four study 
groups. 

Randomisation procedure 

The study biostatistician (MPJ) determined the order of 
assignments using a computer-generated list of random 
numbers and a 3:3:4:4 allocation ratio because the first 
two groups can be pooled for some analyses. Sample size 
was based on a priori power calculations to achieve 80% 
power at a=0.05 for a two-tailed test with a 0.25 effect 
size between each training group and the attention 
control group at 1 year post-randomisation. Block 
randomisation was used to maintain balance on the two 
age strata (50—64 and >65). Block sizes of 4, 8 and 12 
were randomly varied. The assignment for each partici- 
pant's ID number was recorded on a participant letter 
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and then sealed in an opaque envelope with only the ID 
number visible. Two age-stratum-specific boxes 
containing the assignment envelopes were stored in 
a locked cabinet in the Project Coordinator's office. The 
Project Coordinator (MMD) had the responsibility of 
unsealing the envelope (from the appropriate age- 
stratum box) and revealing each participant's group 
assignment. 

Group training logistics 

The three on-site training groups received 10—15 min of 
individual instruction for either Road Tour or the 
crossword puzzles programme, depending on their 
random assignment, in one of two identically configured 
laboratories. After that, a single 'monitor' (usually an 
undergraduate student trained and certified on both 
Road Tour and the crossword puzzles programme) was 
available in one or the other training laboratory (which 
were adjacent to each other) to provide help with any 
questions or issues that arose. Thus, although several 
monitors were needed to accommodate training sched- 
ules and specific monitors were not available for the 
entire enrolment period, at any given training time/ 
session, the monitor was the same. Each of the two 
primary training laboratories had five workstations. Both 
Road Tour training arms (with and without subsequently 
scheduled future booster training) were trained in the 
same laboratory. A total of five weekly 2 h training 
sessions were scheduled for the standard training dose. 
After completing 10 h of training or by 6—8 weeks post- 
randomisation, whichever came first, participants in the 
three on-site training groups were invited back to our 
training laboratories for their post-training assessments 
on the primary outcome. 

Participants randomly assigned to Road Tour training 
at-home were taken to a third adjacent training labora- 
tory in which they were shown (step-by-step) how to load 
the software onto a PC. After this, they received about 

5— 10 min of scripted instruction on how to use Road 
Tour and then practiced using it for about 10—15 min. 
The participants in the at-home Road Tour training 
group were then sent home with the CD containing the 
Road Tour software to load on their home PCs, as well as 
a detailed set of step-by-step instructions containing all 
the screen-shots that they would encounter in doing so. 
They were also given the phone number and email 
information for contacting the Project Coordinator 
(MMD) to answer any questions they might have about 
loading the software onto their home PCs. These 
participants were asked to use Road Tour at home for 
10 h or more during the next 5— 6 weeks without guid- 
ance about the number of sessions or their length and 
were also invited back to our training laboratories at 

6— 8 weeks post-randomisation for their post-training 
assessments on the primary outcome. 

Primary outcome 

The primary outcome in the IHAMS is the Useful Field 
of View (UFOV) PC mouse version. Earlier versions of 



this test have been used in most prior visual speed of 
processing studies, including ACTIVE. w The UFOV 
was administered at randomisation, at post-training 
(6— 8 weeks post-randomisation) and is being adminis- 
tered at the 1 year post-randomisation study end point. 
The UFOV includes three subtests — stimulus identifica- 
tion, divided attention and selective attention — each of 
which is scored from 17 to 500 ms reflecting the shortest 
exposure time at which the participant could correctly 
perform each subtest 75% of the time, with a composite 
milliseconds outcome score ranging from 51 to 1500 ms. 
Consistent with the main reports from the ACTIVE 
trial, 16 17 we used Blom rank transformations 28 on the 
UFOV composite scores at randomisation and post- 
training to normalise the distributions for the multiple 
linear regression and general linear mixed effects 
models. The Blom rank transformations resulted in 
means of zero and SDs of unity and more nearly 
Gaussian distributions. Blom transformations are 
commonly used for distributional normalisation 29 and 
have been shown to yield the most reliable results among 
a variety of alternatives for violations of the distributional 
assumptions of both multiple linear regression and 
general linear mixed effects models. 30 

Secondary outcomes 

Secondary outcomes in the IHAMS include five other 
neuropsychological assessments, all of which were 
administered at randomisation and are being adminis- 
tered at the 1 year post-randomisation study end point. 
These neuropsychological assessments were chosen to 
evaluate whether the effects of visual speed of processing 
training transfer to cognitive function domains beyond 
that represented by the UFOV. The secondary outcomes 
include (1) the Symbol Digit Modalities Test (SDMT), 31 
(2) the Trail Making A and B Tests (TMT), 32 (3) the 
Controlled Oral Word Association Test, 33 (4) the Digit 
Vigilance Test 34 and (5) the Stroop Color and Word Test 
(Stroop). 35 SDMT captures divided attention and 
processing speed and is based on how many of 110 
possible digit-symbol pairs were scored as correct pairs by 
the participant in 90 s. TMT assesses visual scanning 
ability, processing speed and set-shifting/ executive 
functioning and is coded as the number of seconds 
needed to correctly complete connecting the number 
and number— letter sets. Controlled Oral Word 
Association Test assesses verbal fluency based on the 
number of unique words beginning with the letter C 
(or F or L in the second and third trials) generated 
by the participant during 60 s, with a composite score of 
the number of correct words used across the three 
letter trials. Digit Vigilance Test assesses sustained 
attention and psychomotor speed, is performed by 
crossing out randomly placed number 6's in 59 rows of 
numbers and is scored as the error and time totals. The 
Stroop assesses processing speed and executive func- 
tioning and is scored as the correct number of words, 
colours and colour-words identified in 45 s on each 
subtest. 
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The Road Tour training programme 

Road Tour's basic appearance to the user is shown in 
figure 2A. After clicking on the start button to initiate 
training, figure 2B is shown. Here, both the license plate 
area and the eight circular locations in the near orbit 
surrounding it are empty. The empty license plate is 
then replaced, as in figure 2C, with the target vehicle, 
either a car or a truck. Similarly, the eight empty circular 
locations surrounding the license plate are then 
replaced with seven distracter stimuli (rabbit crossing 
signs) or the target sign (Route 66) . The stimuli (car vs 
truck and rabbit crossing vs Route 66 sign) are presented 
for a specified time and are then replaced by figure 2D. 
The amount of time that figure 2C remains on the 
screen before being replaced by figure 2D is measured in 
milliseconds. In figure 2E, both target vehicles (the car 
and truck) are presented in the centre of the screen, one 
of which was previously shown in figure 2C as the target 
vehicle. The user first clicks on the correct target vehicle 
(car or truck) and then on the circular location where 
the correct peripheral target (Route 66 sign) appeared 
(figure 2F). The goal is to improve cognitive processing 
speed by progressively reducing the milliseconds of 
exposure that figure 2C remains on the screen with 
subsequent correct identification of both the stimuli 
(target car or truck) and the target (Route 66) sign. As 
the user progresses, three changes occur which further 
increase task difficulty: (1) the target visual field expands 
by progressing outward from the license plate to add 
medium and distal orbits, (2) these are accompanied by 
an increasing number of distracters to fully populate all 
three orbits (up to 47) and (3) the vehicle pairs morph 
through nine different stages or pairs to become more 
similar and thus more difficult to differentiate. 



Analysis 

First, one-way analysis of variance for selected participant 
characteristics, training time, and the primary and 
secondary outcomes was conducted. To assess the effects 
of Road Tour training (vs attention control training) on 
the primary outcome, we used three intent-to-treat 
analytic approaches, including (1) multiple linear 
regression of composite UFOV scores using Blom rank 
transformations for normalisation (the primary analysis 
specified in the protocol), 25 (2) general linear mixed 
effects models using the Blom rank transformations (as 
a secondary analysis) and (3) multiple logistic regression 
analyses of post-training improvements >100 ms in the 
non-transformed UFOV composite (also as a secondary 
analysis). In each approach, our first model involved the 
single binary contrast of being randomly assigned to any 
Road Tour training, adjusting for the value of the UFOV 
composite at randomisation. We then substituted three 
mutually exclusive binary indicators for the single binary 
contrast. These three binary indicators reflect whether 
the participant was in the on-site speed of processing 
intervention without boosters, the on-site speed of 
processing intervention with boosters subsequently 
scheduled to occur at 11 months post-randomisation or 
the at-home speed of processing group versus those in 
the on-site crossword puzzle (attention control) group as 
the reference or omitted category. We then estimated 
both the first and the second model separately within 
each age stratum. 

RESULTS 

Baseline group comparisons 

Table 1 compares the four training groups on selected 
participant characteristics (including the self-rated 




Figure 2 (A— F) The initial Road Tour sequence. 
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Table 1 Means and SDs (in parentheses) of selected participant characteristics and the five secondary outcome 
neuropsychological tests at randomisation by training group status, N=681 



Overall 



Road Tour 



Road Tour on-site 
with future 



Attention control Road Tour 



Variable 


N = 681 


on-site N = 1 54 


boosters N = 1 48 


on-site N = 188 


at-home N = 1 91 


Personal characteristics 












Age (years) 


61.9 (8.2) 


61.4 (8.1) 


62.5 (8.2) 


61.8 (8.7) 


61.9 (7.9) 


Men (%) 


37.3 (0.5) 


37.2 (0.5) 


32.5 (0.5) 


42.0 (0.5) 


36.7 (0.5) 


Married (%) 


69.9 (0.5) 


73.0 (0.5) 


61.0 (0.5) 


73.4 (0.4) 


71.2 (0.5) 


Single (%) 


11.2 (0.3) 


10.1 (0.3) 


14.9 (0.4) 


8.0 (0.3) 


12.0 (0.3) 


Working (%) 


54.5 (0.5) 


56.8 (0.5) 


53.9 (0.5) 


50.0 (0.5) 


57.6 (0.6) 


Retired (%) 


35.5 (0.4) 


35.1 (0.5) 


36.4 (0.4) 


34.2 (0.5) 


34.6 (0.3) 


Income < $35K (%) 


28.3 (0.5) 


24.3 (0.4) 


36.4 (0.5) 


27.7 (0.5) 


25.7 (0.4) 


Income > $75K (%) 


46.6 (0.5) 


45.3 (0.5) 


41 .6 (0.4) 


47.3 (0.5) 


50.8 (0.5) 


Self-rated health 


3.8 (0.9) 


3.8 (0.9) 


3.8 (0.8) 


3.7 (0.9) 


3.9 (0.8) 


(5=best 1=worst) 












One-year change in 


3.2 (0.8) 


3.3 (0.8) 


3.3 (0.8) 


3.2 (0.8) 


3.3 (0.7) 


self-rated health 












(5=best, 1=worst) 












Training time 












Minutes of training 


469 (217) 


450 (199) 


488 (151) 


535 (154) 


404 (295) 


Neuropsychological tests 












SDMT (number of correct) 


50.5 (9.4) 


51.8 (9.0) 


50.5 (9.5) 


48.7 (9.3) 


51.1 (9.6) 


Trails A (sec) 


41.9 (13.3) 


40.9 (10.9) 


39.8 (12.3) 


45.0 (16.3) 


41.2 (12.0) 


Trails B (sec) 


66.9 (27.2) 


63.8 (30.8) 


65.8 (23.9) 


71.8 (30.3) 


65.2 (22.1) 


COWAT composite 


42.0 (11.9) 


42.4 (11.0) 


41.9 (12.7) 


40.5 (11.5) 


43.2 (12.4) 


(number of words) 












DVT errors (n) 


8.1 (8.2) 


7.5 (9.6) 


9.0 (7.7) 


7.9 (7.6) 


8.0 (7.8) 


DVT time (s) 


377.0 (84.1) 


369.0 (82.2) 


374.8 (83.7) 


387.9 (86.5) 


374.5 (83.1) 


Stroop word (n) 


70.4 (13.1) 


71.2 (13.6) 


71.8 (13.5) 


68.1 (12.8) 


71.1 (12.4) 


Stroop colour (n) 


97.8 (17.6) 


100.3 (17.3) 


96.5 (18.7) 


95.3 (17.8) 


99.3 (16.5) 


Stroop colour-word (n) 


38.1 (9.0) 


38.7 (9.5) 


38.0 (8.7) 


37.1 (9.1) 


38.6 (8.9) 



COWAT, Controlled Oral Word Association Test; DVT, Digit Vigilance Test; SDMT, Symbol Digit Modalities Test. 



health and change in self-rated health from 1-year ago 
items from the SF-36), 36 amount of training (in minutes) 
received and the five secondary outcome neuro- 
psychological tests at randomisation. No statistically 
significant differences were found for any of the partic- 
ipant characteristics. Statistically significant differences 
were observed, however, on the amount of training 
received. The attention control group received the most 
training, while the at-home Road Tour training group 
received the least (despite instructions to the contrary, 
37 of them used one or more of the four other 
programmes in the Insight suite during training, but only 
12 did so for >14 min). This is not surprising given the 
efforts to schedule the five 2 h training sessions for all 
participants in the three on-site training groups. More- 
over, on-site Road Tour participants were allowed to stop 
their training once they had completed all 81 of the 
available exercise sets, which occurred about 5% of the 
time. Finally, although Road Tour directly monitors 
training in minutes based on actual programme usage, 
participant training in the attention control group was 
monitored by project staff based on the completion of 
2 h training sessions. 

Statistically significant differences between the 
training groups were also observed for the SDMT, TMT 



(A and B) and the word and colour subtests of the 
Stroop. In all cases, the attention control group 
demonstrated the lowest level of performance. These 
differences, however, were modest in the absolute, 
although post-hoc comparisons using Dunnett tests 
found eight of the 15 group level contrasts involving the 
attention control group to be statistically significant. The 
attention control group had significantly lower perfor- 
mance than (1) all three training groups on the TMT-A, 
(2) the on-site training group without subsequent 
scheduled boosters on the SDMT, TMT-B and the Stroop 
colour subtest and (3) the on-site training group without 
subsequent scheduled boosters and the at-home training 
group on the Stroop word subtest. Therefore, we will 
adjust for these differences in all subsequent analyses by 
including the value of the outcome measure at 
randomisation. 

Table 2 compares the four training groups on the 
three UFOV subtests — stimulus identification, divided 
attention and selective attention — as well as the UFOV 
composite and Blom rank transformed UFOV compos- 
ites at randomisation and at post-training. No statistically 
significant differences were observed on the three UFOV 
subtests, the UFOV composite or the Blom rank trans- 
formed UFOV composite scores at randomisation, 
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Table 2 Means and SDs (in parentheses) of the three UFOV subtests (stimulus identification, divided attention and selective 
attention), the UFOV Composite and the Blom rank transformed UFOV composite at randomisation and at post-training 


Variable 


Overall 
N = 681 


Road Tour on-site 
Road Tour with future 
on-site N = 154 boosters N = 148 


Attention control 
on-site N = 188 


Road Tour 
at-home N = 191 


Randomisation 
Stimulus identification 
Divided attention 
Selective attention 
UFOV composite 
Blom rank transformed 
UFOV composite 


21.5(20.8) 19.6(9.2) 
75.2 (89.8) 79.1 (98.9) 
203.3(103.1) 202.5(106.3) 
300.0(181.6) 301.2(192.5) 
0.0(1.0) -0.0(1.0) 


22.7 (25.5) 
65.9 (70.2) 
193.7 (94.7) 
282.7 (154.9) 
-0.1 (0.9) 


24.4 (29.6) 
81.4 (94.6) 
214.1 (108.5) 
319.9 (197.1) 
0.1 (1.0) 


21.5 (20.8) 
73.4 (90.9) 

200.7 (101.0) 

292.8 (175.3) 
-0.0 (1.0) 


Post-training 


Overall 
N = 620 


Road Tour 
on-site N = 138 


Road Tour on-site 
with future 
boosters N = 142 


Attention control 
on-site N = 176 


Road Tour 
at-home N = 172 


Stimulus identification 
Divided attention 
Selective attention 
UFOV composite 
Blom rank transformed 
UFOV composite 


18.5 (10.8) 
45.4 (66.9) 

157.5 (93.0) 

221.6 (147.2) 
0.0 (0.8) 


17.7 (5.8) 
37.6 (50.3) 
135.1 (75.9) 
190.5 (114.0) 
-0.1 (0.7) 


17.3 (4.4) 
44.7 (64.0) 
149.1 (87.8) 
211.6 (137.6) 
-0.0 (0.9) 


20.8 (17.5) 
63.1 (89.9) 
201.6 (106.6) 
285.5 (182.4) 
0.4 (0.8) 


17.9 (7.8) 
34.3 (47.4) 
136.9 (79.0) 
189.1 (114.8) 
-0.2 (0.8) 


UFOV, Useful Field of View. 













although the attention control group had the slowest 
performance in all comparisons. At post-training, 
however, statistically significant differences were 
observed on the three UFOV subtests, on the UFOV 
composite score and on the Blom rank transformed 
UFOV composite score. Moreover, Dunnett tests indi- 
cated that all the training group comparisons involving 
the attention control group were statistically significant 
as well. 

Multiple linear regression 

The first panel of table 3 contains the results from the 
multiple linear regression analysis of the Blom rank 
transformed UFOV composite scores at post-training 
predicted by the Blom rank transformed UFOV 
composite scores at randomisation and the single binary 
contrast of being randomly assigned to any Road Tour 
training for all 620 IHAMS participants with complete 
data. The second and third panels contain the results 
from similar analyses stratified on age (50—64 vs ^65). 
Because the Blom rank transformed UFOV composite 
scores have been normalised to have a mean of zero and 
a SD of unity, the unstandardised b coefficients shown 
may be directly interpreted as effect size estimates. The 
effect sizes are —0.558 in the pooled analysis, —0.479 for 
die >65 age stratum and —0.626 for the 50—64 age 
stratum, with all three p values <0.001. Although the 
magnitudes of the effect sizes appear larger in the 
younger age stratum than in the older age stratum, note 
that all effect sizes are within the 95% CIs of each other 
and are thus functionally comparable. This was verified 
by adding a binary marker for age strata and its inter- 
action with having any Road Tour training to the model, 
neither of which were statistically significant. 



Table 4 contains the results from the multiple linear 
regression analysis of the Blom rank transformed UFOV 
composite scores when the single binary contrast of 
being randomly assigned to any Road Tour training is 
replaced by the set of three binary indicators reflecting 
each specific Road Tour training group. As in table 3, the 
first panel of table 4 contains the results for all 620 
IHAMS participants with complete data, while the 
second and third panels contain the results from anal- 
yses stratified on age (50—64 vs >65). Also as in table 3, 
all the coefficients shown may be directly interpreted as 
effect size estimates, and all have p values <0.001. The 
effect sizes in table 4 for each of the Road Tour training 
groups are very similar to those shown in table 3 for the 
pooled markers. Here, too, the magnitude of the effect 
sizes for each training group appears larger in the 
younger age stratum than in the older age stratum, but 
once again, all effect sizes are within the 95% CIs of each 
other and are thus functionally comparable. Similarly, 
while the effect sizes within panels appear smallest for 
the on-site training group not scheduled to receive 
future booster training, only for the younger age stratum 
do these lie outside of each other's 95% CIs and then 
only when compared with the at-home training group. 
Taken together, the multiple linear regression results 
contained in tables 3 and 4 support our hypothesis for 
the post-training effects in all respects. 

General linear models with mixed effects 

We used general linear models with mixed effects as 
a secondary analytic approach to adjust for the corre- 
lated errors within participants that may arise from the 
repeated UFOV measurement (which the primary 
multiple linear regression analyses do not address). 3 
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Table 3 Pooled and age-stratum-specific multiple linear regression results for predicting the Blom rank transformed composite 
UFOV score at 6— 8 weeks post-randomisation 





Unstandardised 
regression coefficient b 


p Value 


Lower 95% CI 


Higher 95% CI 


Pooled analysis with both age strata (N=620) 










Intercept 


U.410 


U.UU I 


u.ouy 


n con 


Any Road Tour training (N=444) 


0.558 


0.001 


— 0.433 


—0.683 


On-site attention control (N=176) 


0.000 








Blom rank transformed UFOV at randomisation 


U.o4o 


U.UU I 


U.OOO 


U./UU 


R squared 


0.491 


U.UU I 






Separate analysis in the >65 age stratum (N=209) 










Intercept 


0.518 


U.UU I 


U.o4o 


n cn/i 

u.t>y4 


Any Road Tour training (N=154) 


-0.479 


0.001 


—0.290 


—0.668 


On-site attention control (N=55) 


0.000 








Blom rank transformed UFOV at randomisation 


0.650 


U.UU I 


U.O^f / 


U. / O^f 


R squared 


0.482 


0.001 






Separate analysis in the 50—64 age stratum (N=411) 








Intercept 


0.352 


0.001 


0.218 


0.486 


Any Road Tour training (N=292) 


-0.626 


0.001 


-0.467 


-0.785 


On-site attention control (N=119) 


0.000 








Blom rank transformed UFOV at randomisation 


0.556 


0.001 


0.479 


0.634 


R squared 


0.413 


0.001 







UFOV, Useful Field of View. 



The results from the general linear mixed effects model 
for the effect of being randomly assigned to any Road 
Tour training for all 620 IHAMS participants with 
complete data revealed (data not shown) a statistically 
significant (p<0.001) interaction between the Blom rank 



transformed outcome and any Road Tour training 
reflecting a standardised mean difference (effect size) of 
—0.430. When this model was ran separately within age 
strata, the standardised mean difference was —0.378 
(p<0.001) in the older stratum and -0.490 (p<0.001) in 



Table 4 Pooled and age-stratum-specific multiple linear regression results for predicting the Blom rank transformed composite 


UFOV score at 6— 8 weeks post-randomisation 












Unstandardised 








regression coefficient b 


p Value 


Lower 95% CI 


Higher 95% CI 


Pooled analysis with both age strata (N=620) 










Intercept 


0.415 


0.001 


0.309 


0.520 


Road Tour on-site (N=139) 


-0.457 


0.001 


-0.299 


-0.616 


Road Tour on-site with future boosters (N=136) 


-0.585 


0.001 


-0.426 


-0.745 


On-site attention control (N=174) 


0.000 








Road Tour at home (N=171) 


-0.629 


0.001 


-0.469 


-0.769 


Blom rank transformed UFOV at randomisation 


0.642 


0.001 


0.585 


0.699 


R squared 


0.495 


0.001 






Separate analysis in the &65 age stratum (N=209) 










Intercept 


0.520 


0.001 


0.343 


0.697 


Road Tour on-site (N=47) 


-0.465 


0.001 


0.226 


-0.704 


Road Tour on-site with future boosters (N=46) 


-0.480 


0.001 


-0.240 


-0.721 


On-site attention control (N=55) 


0.000 








Road Tour at home (N=61) 


-0.490 


0.001 


-0.263 


-0.718 


Blom rank transformed UFOV at randomisation 


0.648 


0.001 


0.542 


0.697 


R squared 


0.482 


0.001 






Separate analysis in the 50—64 age stratum (N=411) 








Intercept 


0.353 


0.001 


0.219 


0.486 


Road Tour on-site (N=92) 


-0.483 


0.001 


-0.280 


-0.685 


Road Tour on-site with future boosters (N=90) 


-0.665 


0.001 


-0.462 


-0.869 


On-site attention control (N=119) 


0.000 








Road Tour at home (N=110) 


-0.711 


0.001 


-0.519 


-0.903 


Blom rank transformed UFOV at randomisation 


0.560 


0.001 


0.483 


0.638 


R squared 


0.421 


0.001 






UFOV, Useful Field of View. 
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the younger stratum. Once again, although these effect 
sizes appear larger in the younger stratum, these differ- 
ences were not statistically significant, as indicated when 
the binary marker for age strata and its interaction with 
any Road Tour training (a group-by-time-by-age stratum 
interaction) was added to the general linear model for 
all IHAMS participants. 

When the single binary contrast of being randomly 
assigned to any Road Tour training was replaced by the set 
of three binary indicators reflecting each specific Road 
Tour training group for all IHAMS participants, stand- 
ardised mean differences (compared with the attention 
control group) of —0.356, —0.448 and —0.475 were 
obtained for the on site Road Tour without subsequently 
scheduled future booster training, on site Road Tour with 
scheduled future booster training and at-home Road Tour 
training groups, all of which were statistically significant 
(p<0.001). Similar results were obtained when this 
general linear model was estimated within age strata. Once 
again, no group-by-time-by-age stratum interactions were 
observed in the general linear mixed effects model for all 
IHAMS participants. Thus, when taken together, the 
general linear mixed effects modelling results also support 
our hypothesis for the post-training effects in all respects. 

Multiple logistic regression 

The multiple logistic regression analysis was conducted 
to ensure that both analyses of the Blom rank trans- 
formed UFOV composites were not statistical artefacts of 
the normalisation algorithm. An effect threshold of 
improvements >100 ms was chosen because it represents 
an effect size of 0.55 based on the non-transformed 
baseline UFOV composite, which is equivalent to that 
observed in table 3 for the pooled analysis of assignment 
to any Road Tour training in the overall IHAMS sample. 
The adjusted odds ratio for being randomised to any 
Road Tour training group on achieving a post-training 
improvement in the UFOV test > 100 ms was 4.85 
(p<0.001). The absolute improvement effect was 12.2% 
(34.3% of Road Tour subjects improved >100ms vs 
23.1% or attention control subjects). This simple model 
fit the data extremely well (area under the, curve (AUC) = 
0.92). We then replaced the single binary marker with 
the three indicators for each of the Road Tour training 
groups and found that while the three Road Tour 
training groups' adjusted odds ratios varied from 4.01 to 
5.52 (p values<0.001; AUC=0.92; absolute improvement 
effects 10.0%-12.5%), they all fell within the others' CIs, 
reflecting similar effect sizes. Comparable results were 
found (not shown) within age strata, although the model 
for the younger age stratum fit the data slighdy better 
(AUC=0.95 vs AUC=0.86). Thus, when taken together, 
these multiple logistic regression results also support our 
hypothesis for the post-training effects in all respects. 

CONCLUSIONS 

Gradual cognitive decline is nearly universal and is well 
recognised as a normal part of the ageing process. 



According to Salthouse,' most age-related cognitive 
deteriorations are at least partially attributable to 
declines in information processing speed, which affects 
episodic and working memory, verbal fluency and 
reasoning abilities. Previous work, especially the US NIH- 
funded multisite ACTIVE trial, has led to the develop- 
ment of a promising, second-generation computer-based 
intervention to improve visual processing speed known 
as Road Tour. We designed the IHAMS to assess the 
efficacy and effectiveness of Road Tour. 

There are five important aspects of IHAMS that 
warrant further mention. First, the IHAMS overcomes 
five major limitations of the previous US NIH-funded 
ACTIVE multisite RCT, the first three of which we were 
able to directly evaluate in this article reporting on the 
post-training results. In addition to participants aged 
65 years or older, the IHAMS included 50— 64-year-olds 
to determine whether speed of processing training is 
efficacious and effective before substantial cognitive 
decline occurs in the seventh decade. 39 If speed of 
processing training is efficacious in this younger cohort, 
preventive interventions could focus on improving 
cognitive functioning before the rapid age-related 
declination process even begins. The IHAMS also used 
an attention control group that was trained on compu- 
terised crossword puzzles rather than a no-contact 
control group. This allowed us to directly evaluate the 
potential that placebo effects cloud the interpretation of 
the results from ACTIVE. 25 By using Road Tour rather 
than its predecessor, the IHAMS avoids reliance on 
a supervised training intervention. This allowed us to 
directly evaluate whether sending participants home 
with the software to use on their own PCs is efficacious, 
and if so, whether it was as effective as supervised on-site 
training, which potentially expands substantially the 
ability to implement widespread public health interven- 
tions. The IHAMS also directly randomised participants 
to receive or not receive on-site booster training, as 
opposed to the adherence-conditioned assignment to 
booster training used in ACTIVE. When the 1-year 
follow-up data become available, this will allow us to 
separate the effects associated with standard dosing from 
those derived from standard dosing plus booster 
training. The IHAMS also included five additional 
neuropsychological tests assessed at baseline that will 
also be assessed at the 1-year follow-up as secondary 
outcomes. Once the 1-year follow-up data become 
available, this will allow us to assess the extent to which 
Road Tour effects on the primary outcome transfer to 
the other cognitive functions tapped by these neuro- 
psychological tests. 

The second important aspect of this study involves the 
training intervention itself. Road Tour is easy to use on 
any PC (versions for both PC and Apple platforms are 
available) at any location. Adherence to training was very 
good, even in the at-home training group, which did not 
benefit from the support of weekly scheduling contacts. 
The targeted standard training dose was just 10 h, 
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although the mean amount of time that it was used in 
the two on-site training groups was only 7.8 h spread over 
a 5-week period. The 2 h training sessions were 
extremely well tolerated, and no discomfort of any kind 
was reported by any participant during delivery of the 
standard training dose. In sum, the ability to readily 
implement Road Tour training in widespread public 
health interventions is extremely promising from 
a logistical perspective. 

The demonstrated efficacy of Road Tour to improve 
UFOV scores in these interim analyses is the third 
important aspect of this study that warrants further 
mention. Three different analytic approaches — multiple 
linear regression, general linear mixed effects and 
multiple logistic regression models — all substantially 
supported our hypothesis for the post-training effects in 
all respects. The primary analytic approach was the 
pooled multiple linear regression of the Blom rank 
transformed UFOV composite at post-training. When 
these analyses were done pooling both age strata, the 
regression coefficient for random assignment to any 
Road Tour training group versus the attention control 
group was statistically significant (p<0.001) with an 
effect size of —0.558 (adjusted for the Blom rank trans- 
formed UFOV test at randomisation). Similar results 
were also obtained when comparing each of the three 
training groups with the attention control group. 
That this medium effect size was obtained with an 
average of <8 h of training suggests that the potential 
for widespread public health interventions is very 
promising. 

Directly comparing the efficacy of Road Tour obtained 
in these IHAMS interim analyses to the speed of 
processing training results obtained from a meta-analysis 
consisting of ACTIVE and five other visual speed of 
processing training RCTs with a total enrolment of 907 
subjects followed for varying time lengths 13 is problem- 
atic for at least four reasons. First, most of those RCTs 
used the touch screen version of the UFOV, which has 
four subtests and yields a composite score that ranges 
between 68 and 2000 ms, while IHAMS used the PC 
mouse version, which has only three subtests and yields 
a composite score that ranges between 51 and 1500 ms. 
Second, most of those RCTs used a no-contact control 
group design that added any potential placebo effect to 
their training effect estimates. Moreover, IHAMS used an 
attention control group that was trained using a compu- 
terised crossword puzzle programme that may have led 
to some improvement in processing speed beyond the 
potential placebo effect. Third, all those RCTs used the 
predecessor version of the speed of processing software 
that required supervised on-site training. Fourth, IHAMS 
used less robust mental status and self-reported visual 
acuity screening tools than those RCTs for exclusion 
purposes, which enhances the generalisability of the 
IHAMS while biasing its effect size estimates towards the 
null. Taking the four differences noted above into 
consideration, the effect sizes for those six RCTs 



are quite comparable to the post-training effect size 
estimated from our multiple linear regression model 
of —0.56 and from our general linear mixed effects 
model of -0.43. 

The fourth important aspect of this study that warrants 
further mention involves the comparison of the on-site 
versus the at-home training effects in these interim 
analyses. For the two on-site Road Tour training groups, 
the effect size estimates from the multiple linear 
regression model were —0.457 and —0.585, while the 
effect size estimate for the at-home training group 
was —0.629. Thus, the effect size was largest for the at- 
home training group, although all three estimates are 
within the others' 95% CIs, reflecting their compara- 
bility. Therefore, the benefits that accrue from Road 
Tour training can be achieved using a home PC without 
supervision, which substantially increases the opportu- 
nity to implement speed of processing training in 
widespread public health interventions. 

The final aspect of this study that warrants further 
mention involves the efficacy equivalence between the 
two age strata in these interim analyses. Among older 
adults (>65 years old), the estimated effect size from the 
multiple linear regression analysis was —0.479, while it 
was —0.626 among younger adults (50— 64 years old). 
Moreover, when an interaction term was added to the 
model in the pooled analysis, no statistical difference in 
these estimates was observed. This finding of equiva- 
lence in the efficacy of Road Tour between the age strata 
is extremely promising because it suggests that preven- 
tive interventions could focus on improving cognitive 
functioning at an earlier stage of age-related decline. 

In conclusion, we note that although our study has 
numerous strengths, it does have limitations, four of 
which are worth mentioning. First, although large, the 
sample was drawn from just one FCC in which minorities 
were under-represented. Second, to be eligible, partici- 
pants had to have a home computer and internet access. 
Third, only one of the five training programmes 
included in Posit Science's Insight suite (Road Tour) was 
studied. Finally, only data on the primary outcome were 
available and then only at randomisation and post- 
training. The first two of these limitations constrain the 
generalisability of the IHAMS somewhat, while the last 
two leave the issues of potential benefits from multifac- 
eted training (using all five of the training programmes 
in the Insight suite) and the transferability to the five 
other neuropsychological outcomes unresolved. 
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